Image processing apparatus, control method for image processing apparatus, and storage medium

ABSTRACT

In response to a start of a pinch-out operation in a first display area displaying a preview image, display is switched from a first display mode to a second display mode, and in a case where a pinch-in operation in the first display area ends and a display size of the preview image reaches a predetermined threshold, the display is switched from the second display mode to the first display mode.

BACKGROUND OF THE INVENTION

Field of the Invention

The present disclosure generally relates to image processing and, moreparticularly, to an image processing apparatus, a control method for theimage processing apparatus, and a storage medium.

Description of the Related Art

In recent years, an image processing apparatus with a touch panelcapable of detecting multi-touch operations to allow an intuitive useroperation has become widespread. Such a multi-touch operation performedon the touch panel includes pinch-in and pinch-out. The pinch-in is anoperation of moving two fingers as if pinching an object displayed on atouch panel with the two fingers. This operation allows a user to reducethe object size intuitively. The pinch-out is an operation of moving twofingers as if stretching an object displayed on a touch panel with thetwo fingers. This operation allows a user to enlarge the object sizeintuitively.

Japanese Patent Application Laid-Open No. 2013-190982 discusses reducingan enlarged image displayed on a display, based on a pinch-in operation,and ending enlargement display of the image when a display scalingfactor of the image becomes equal to or below a predetermined threshold.

In this case, when an image is enlarged and displayed, a screen layoutmay be different from a screen layout before the image is enlarged anddisplayed. For example, various operation buttons for the displayedimage may be displayed before the image is enlarged and displayed, andthese operation buttons may be hidden when the image is enlarged anddisplayed. In such a case, if a user continually performs operations forincreasing and decreasing the distance between two fingers whiletouching the surface of a touch panel, the image is enlarged and reducedalternately. At that time, if whether a display size of the imageexceeds a threshold is set as the only condition for switching betweendisplay and non-display of the above-described operation buttons,switching between two display forms having different screen layoutsoccurs continually. As a result, the screen viewed by the user flickers,which may hinder provision of comfortable operability.

The present disclosure is directed to a technique capable of providingcomfortable operability for a user, in switching between two displaymodes having different screen layouts, based on a multi-touch operation.

SUMMARY OF THE INVENTION

According to an aspect of the present disclosure, an image processingapparatus with a touch panel, includes a detection unit configured to becapable of detecting a touch of an input instruction member on the touchpanel, and a position of the touch of the input instruction member, anda release of the input instruction member touching the touch panel fromthe touch panel, and a display control unit configured to be capable ofswitching between a first display mode for displaying a screen includinga first display area for displaying a preview image and a second displayarea different from the first display area, and a second display modefor expanding the first display area to be larger than the first displayarea in the first display mode, and hiding the second display area, orreducing the second display area and displaying the reduced seconddisplay area, wherein, in the first display mode, in a case where thedetection unit detects an increase in a distance between at least twoinput instruction members from a state where the at least two inputinstruction members are in contact with the first display area, thedisplay control unit enlarges the preview image displayed in the firstdisplay area, and switches the display to the second display mode, andwherein, in the second display mode, in a case where the detection unitdetects a decrease in a distance between at least two input instructionmembers from a state where the at least two input instruction membersare in contact with the first display area, the display control unitreduces the preview image displayed in the first display area, and in acase where the detection unit detects a release of at least one of theat least two input instruction members from the first display area, thedisplay control unit switches the display to the first display mode.

Further features of the present disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an example hardware configurationof an image processing apparatus according to an exemplary embodiment ofthe present invention.

FIGS. 2A, 2B, and 2C are diagrams each illustrating an example of ascreen displayed on a display of the image processing apparatus.

FIG. 3 (consisting of FIGS. 3A and 3B) is a flowchart illustratingdisplay switching processing for a preview screen.

DESCRIPTION OF THE EMBODIMENTS

An exemplary embodiment of the present disclosure will be describedbelow with reference to the drawings. The following exemplary embodimentis not intended to limit the disclosure according to the scope ofclaims, and any combination of features described in the exemplaryembodiment is not necessarily essential to a solution in the disclosure.

FIG. 1 is a block diagram illustrating an example hardware configurationof an image processing apparatus according to the present exemplaryembodiment. Referring to FIG. 1, a multi function peripheral (MFP) isdescribed as an example of the image processing apparatus.

An MFP 101 includes various units such as a central processing unit(CPU) 111 and a printer 122. The CPU 111, a random access memory (RAM)112, a read only memory (ROM) 113, an input unit 114, a display controlunit 115, an external memory interface (I/F) 116, and a communicationI/F controller 117 are connected to a system bus 110. Further, a touchpanel 118, a display 119, and an external memory 120 are connected tothe system bus 110. The processing units are configured to be capable ofexchanging data via the system bus 110 with each other. As used herein,the term “unit” generally refers to any combination of software,firmware, hardware, or other component, such as circuitry, that is usedto effectuate a purpose.

The ROM 113 is a nonvolatile memory, and stores image data, other kindsof data, various programs for operation of the CPU 111, and the like, inthe respective predetermined areas. The RAM 112 is a volatile memory,and used as a temporary storage area serving as a main memory, a workarea, and the like for the CPU 111. The CPU 111 uses the RAM 112 as awork memory, according to a program stored in the ROM 113, for example,thereby controlling each part of the MFP 101. The programs for operatingthe CPU 111 may be stored beforehand in the external memory 120 (such asa hard disk), without being limited to the ROM 113.

The input unit 114 receives a user operation, and generates a controlsignal according to the received operation. The input unit 114 thensupplies the generated control signal to the CPU 111. For example, theinput unit 114 receives the user operation from a keyboard (notillustrated), a mouse (not illustrated), or the touch panel 118 servingas an input device. The touch panel 118 is an input device configured tooutput coordinate data according to, for example, a touched position ona flat input section. The CPU 111 controls each part of the MFP 101according to a program, based on the control signal generated and thensupplied by the input unit 114 in response to the user operationperformed on the input device. The MFP 101 can thereby operate accordingto the user operation.

The display control unit 115 outputs a display signal for causing thedisplay 119 to display an image. For example, the CPU 111 generates adisplay control signal according to a program, and supplies thegenerated display control signal to the display control unit 115. Basedon this display control signal, the display control unit 115 generates adisplay signal and outputs the generated display signal to the display119. For example, the display control unit 115 causes the display 119 todisplay a graphical user interface (GUI) screen forming a GUI, based onthe display control signal generated by the CPU 111.

The touch panel 118 is integrally configured with the display 119, andserves as a touch panel display. For example, a manufacturer configuresthe touch panel 118 to have enough light transmittance not to disturbdisplay of the display 119, and attaches the touch panel 118 to an upperlayer of a display surface of the display 119. The manufacturer thenassociates input coordinates on the touch panel 118, with displaycoordinates on the display 119. This forms a GUI in which the user candirectly operate a screen displayed on the display 119. The touch panel118 may be of any of various types including a resistive type, acapacitive type, an optical type, a surface acoustic wave type, aninfrared type, an electromagnetic induction type, an image recognitiontype, and an optical sensor type.

To the external memory I/F 116, the external memory 120 is mountable.Examples of the external memory 120 include a hard disk, a floppy(registered trademark) disk, a compact disc (CD), a digital versatiledisc (DVD), and a memory card. The external memory I/F 116 reads datafrom and writes data into the mounted external memory 120, based on thecontrol by the CPU 111.

The communication I/F controller 117 performs communication for anetwork 102, which is, for example, any of various kinds of networkssuch as a local area network (LAN), the Internet, and wire and wirelessnetworks, based on the control by the CPU 111. For example, thecommunication I/F controller 117 allows image data generated by ascanner 121 to be transmitted outside via the network 102, and allowsimage data received from outside via the network 102 to be printed bythe printer 122. Various devices such as a personal computer (PC), adifferent MFP, a printer, and a server are connected to the network 102,to be able to communicate with the MFP 101.

The scanner 121 generates image data by reading an image on an originaldocument. The generated image data is stored into the RAM 112, the ROM113, or the like. The printer 122 prints out the image data onto a printmedium, based on a user instruction input via the input unit 114 or acommand input from an external device via the communication I/Fcontroller 117. Further, a copy function is implemented by causing theprinter 122 to perform printing based on the image data generated by thescanner 121.

The CPU 111 can identify, for example, gesture operations and states onthe touch panel 118. The gesture operations and states include a touchby a finger or pen (an input instruction member) on the touch panel 118(hereinafter, referred to as “touch-start”), and a movement of thefinger or pen while touching the touch panel 118 (hereinafter, referredto as “touch-move”). The gesture operations and states further include arelease of the finger or pen from the touch panel 118 (hereinafter,referred to as “touch-end”), a state where there is no touch on thetouch panel 118 (hereinafter, referred to as “touch-off”), and the like.The CPU 111 is notified of information representing these operations andposition coordinates of the finger or pen touching the touch panel 118,via the system bus 110. The CPU 111 can identify an operation performedon the touch panel 118, based on the received information. As for thetouch-move, a moving direction of the finger or pen moving on the touchpanel 118 can also be determined for each of a vertical component and ahorizontal component on the touch panel 118, based on a change in theposition coordinates. Further, an operation of quickly performing thetouch-end after the touch-start on the touch panel 118 is referred to as“click”. Furthermore, when the touch-end is performed after performingthe touch-move for a certain distance from when the touch-start has beenperformed on the touch panel 118, it is assumed that the drawing of“stroke” is performed. An operation of quickly drawing the stroke isreferred to as “flick”. The flick is an operation of quickly moving afinger for some distance while keeping the finger touching a touchpanel, and then releasing the finger from the touch panel. In otherwords, the flick is an operation of quickly sliding the finer on thetouch panel, like flipping the touch panel. The CPU 111 determines thatthe flick is performed, when detecting a movement of the inputinstruction member for a predetermined distance or longer at apredetermined speed or higher, and subsequently detecting the touch-end,based on a change in the position coordinates of the detectedtouch-move. Further, the CPU 111 determines that a drag is performed,when detecting a movement of the input instruction member for apredetermined distance or longer, based on a change in the positioncoordinates of the detected touch-move.

Further, the touch panel 118 supports multi-touch, and is capable ofsimultaneously detecting two or more positions subjected to touch-on ortouch-move. There is a case where two input instruction members such asfingers or stylus-pens touching on a touch panel, and from this state,one or both of the fingers are moved to increase or decrease thedistance between two points, in a direction of connecting the twopoints. A user operation of bringing two fingers closer to or away fromeach other is similar to an act of pinching or stretching an object withfingers, and is therefore called “pinch operation”. An operation ofincreasing the distance between two fingers is referred to as“pinch-out”, and an operation of decreasing the distance between twofingers is referred to as “pinch-in”.

The pinch operation is normally performed with a thumb and a forefingerof a user. When each or one of touch positions is moved from a statewhere two points are simultaneously touched, the CPU 111 determines thatthe pinch operation has started. Further, the CPU 111 can calculate thecoordinates of a center point of a line segment connecting the twopoints in the pinch operation, and the distance between the two points.The CPU 111 instructs the display control unit 115 to enlarge adisplayed image, when the distance between the touch positions at thetwo points is equal to or greater than a predetermined value storedbeforehand in a storage area. When the finger or pen leaves the touchpanel 118 so that there is one or no touch, the CPU 111 detects thisstate as the touch-end, and determines that the pinch-out operation hasended. Similarly, the CPU 111 instructs the display control unit 115 toreduce the displayed image, when the distance between the touchpositions at the two points is equal to or less than a predeterminedvalue stored beforehand in a storage area. When the finger or pen leavesthe touch panel 118 so that there is one or no touch, the CPU 111detects this state as the touch-end, and determines that the pinch-inoperation has ended.

Next, a preview function of the MFP 101 will be described. In thepresent exemplary embodiment, the preview function is a function ofcausing the display 119 to display image data stored in the RAM 112 orthe external memory 120. The CPU 111 performs display control forcausing the display 119 to display a preview screen including one ormore pages. In other words, the CPU 111 generates image data in a formatsuitable for display on the display 119, among the stored image data.The image data in the format suitable for the display in the display 119is hereinafter referred to as “preview image”. The image data stored inthe external memory 120 may be configured of two or more pages. In thiscase, the preview image is generated for each of the pages. The previewfunction is not limited to a preview before printing by the printer 122,and is applicable to all uses, for confirming contents of image data.

The MFP 101 can store the image data into the RAM 112 or the externalmemory 120 by some ways. For example, the MFP 101 stores image datagenerated from an image on an original document read by the scanner 121.Alternatively, the MFP 101 stores image data received from an externaldevice such as a PC or the like connected to the network 102, via thecommunication I/F controller 117. Alternatively, the MFP 101 storesimage data received from a portable storage medium (such as a UniversalSerial Bus (USB) memory and a memory card) mounted to the externalmemory I/F 116. The MFP 101 may store image data into the externalmemory 120, in any other ways. The stored image data may be datareflecting various kinds of setting information including print settinginformation for an original document read by the scanner 121. Further,the image data displayed on the display 119 may include characterinformation, or image information such as a picture and a graphic image,or may include both of these kinds of information, and/or other kinds ofinformation. Furthermore, the image data may be a sample imageinternally stored beforehand.

FIGS. 2A, 2B, and 2C are screen examples each illustrating a previewimage displayed on the display 119 of the MFP 101. A preview screen 200illustrated in FIG. 2A is provided to display a preview image, andincludes a preview display area 201, a navigation area 217, and a pagecontrol area 218.

The preview display area 201 is provided to display a preview image 202,and can receive a gesture operation of the user. In the presentexemplary embodiment, a preview image for one page is displayed in thepreview display area 201, but two or more pages may be simultaneouslydisplayed. The CPU 111 of the MFP 101 detects a gesture operation forthe preview display area 201, and can operate display of the previewimage 202. Examples of the gesture operation include the above-describedflick, drag, pinch-in, and pinch-out, but any other operation may beadopted as the gesture operation. The area that receives the gestureoperation may include an area around the preview display area 201.

The preview image 202 is an image created by reducing/enlarging thestored image data to a size suitable for display. Alternatively, thepreview image 202 may be an image created based on various settingsincluding print settings for image data.

A close (CLOSE) button 203 is a button for closing the preview screen200, and shifting the screen to a different screen. When the usertouches this button, the CPU 111 ends the preview function.

A transmission instruction (SEND) button 204 is a button used to providean instruction for transmitting the displayed image data. When the usertouches this button, the CPU 111 performs transmission processing fortransmitting the image data to an external device such as a PC connectedto the network 102. Further, the CPU 111 closes the preview screen 200,and shifts the screen to a different screen. The CPU 111 hides thetransmission instruction button 204, in a state where information fortransmission (such as a transmission destination) is not set before ashift to the preview screen 200. To stop the transmission processing, astop button (not illustrated) is provided. When the user touches thestop button, the CPU 111 stops the transmission processing, and closesthe preview screen 200, to shift the screen to a different screen. TheCPU 111 hides the stop button, in a state where information fortransmission is not set before a shift to the preview screen 200. Whenthe stop button is displayed, the close button 203 is hidden.

A print instruction (PRINT) button 205 is a button used to provide aninstruction for printing the displayed image data. When the user touchesinstruction button 205, the CPU 111 causes the printer 122 to startprint processing, and closes the preview screen 200, and shifts thescreen to a different screen. In a state where information for printing(such as an output sheet size, and the number of output copies) is notset, the CPU 111 hides the print instruction button 205.

A preview image enlargement button 206 is provided to enlarge thepreview image 202 displayed in the preview display area 201, and todisplay the enlarged preview image 202. When the user touches thepreview image enlargement button 206, the CPU 111 increases the size ofthe preview image 202, and then displays the preview image 202 in thepreview display area 201.

A page number display area 207 is provided to display the total numberof pages and the page number corresponding to the currently displayedpreview image 202, when the image data includes two or more pages. Whenthe displayed page is changed, the CPU 111 determines what page numbercorresponds to the preview image 202, and updates the display content ofthe page number display area 207. In the example of FIG. 2A, the totalnumber of pages is five, and the third page is currently displayed.

A page backward button 208 is a change button used to provide a pagechange instruction for moving backward from the displayed preview image202 to the previous page, when the image data includes two or morepages. When the user touches the page backward button 208, the CPU 111reads out the image data corresponding to the previous page, anddisplays the previous page by replacing the currently displayed previewimage 202 with the previous page. Alternatively, when two or more pagesare simultaneously displayed in the preview display area 201, the CPU111 updates the display content, so that the preview image 202corresponding to the previous page is placed at the center of thepreview display area 201.

A page forward button 209 is a change button used to provide a pagechange instruction for moving forward from the displayed preview image202 to the next page, when the image data includes two or more pages.When the user touches the page forward button 209, the CPU 111 reads outthe image data corresponding to the next page, and displays the nextpage by replacing the currently displayed preview image 202 with thenext page. Alternatively, when two or more pages are simultaneouslydisplayed in the preview display area 201, the CPU 111 updates thedisplay content, so that the preview image 202 corresponding to the nextpage is placed at the center of the preview display area 201.

A page deletion (DELETE PAGE) button 210 is provided to delete the pagecorresponding to the displayed preview image 202, from the image data.When the user touches the page deletion button 210, the CPU 111 displaysa deletion confirmation screen (not illustrated) to be overlaid on thepreview screen 200, thereby prompting the user to select whether todelete the corresponding page from the image data.

A file type display area 211 is provided to display a file typeassociated with the displayed image data. When the format of the imagedata is Portable Document Format (PDF), the CPU 111 displays an imageindicating PDF, in the file type display area 211. When the format isJoint Photographic Experts Group (JPEG), the CPU 111 displays an imageindicating JPEG. When no file type is associated with the image data,the CPU 111 hides the file type display area 211.

A file name display area 212 is provided to display a file nameassociated with the displayed image data. When no file name isassociated with the image data, the CPU 111 hides the file name displayarea 212.

The navigation area 217 is provided to display various buttons, whichare each used to provide an instruction for performing processing forthe preview image 202. The navigation area 217 displays the close button203, the transmission instruction button 204, and the print instructionbutton 205. The buttons in the navigation area 217 are associated with adisplay condition of the navigation area 217. When the navigation area217 is not displayed, the close button 203, the transmission instructionbutton 204, and the print instruction button 205 are not displayedeither.

The page control area 218 is provided to display various buttons, whichare each used to control the page of the preview image 202 displayed inthe preview display area 201. The page control area 218 displays thepage number display area 207, the page backward button 208, the pageforward button 209, and the page deletion button 210. The buttons andarea in the page control area 218 are associated with a displaycondition of the page control area 218. When the page control area 218is not displayed, the page number display area 207, the page backwardbutton 208, the page forward button 209, and the page deletion button210 are not displayed either.

Here, enlargement display control for the preview image 202 by thepinch-out operation of the user will be described. In the presentexemplary embodiment, the user can enlarge and display the preview image202, by performing the pinch-out operation while touching the previewdisplay area 201 with fingers, or pens. In addition, with theenlargement of the preview image 202, the navigation area 217 and thepage control area 218 are hidden, and the range of the preview displayarea 201 occupying the preview screen 200 is expanded.

Assume that the pinch-out operation for the preview display area 201 isperformed, and the amount of a change in the distance between touchpositions at two points becomes a predetermined value or greater. TheCPU 111 then changes the layout of the preview screen 200, and performsprocessing of increasing the display size of the preview image 202according to the amount of the change. Further, the CPU 111 identifiestouch center coordinates of touch positions at two or more points, andplaces the preview image 202 at a position enlarged with reference tothe identified touch center coordinates, relative to the preview displayarea 201.

In addition, with the enlargement of the preview image 202, thenavigation area 217 and the page control area 218 are hidden, and thedisplay of the preview display area 201 occupying the preview screen 200is expanded.

The navigation area 217 and the page control area 218 may be hiddensimultaneously with processing of enlarging the preview image 202.Alternatively, the navigation area 217 and the page control area 218 maybe hidden when a movement occurs for a distance equal to or greater thana predetermined value, which is different from the predetermined valuefor determination of the pinch-out operation and stored beforehand in astorage area.

The preview screen 200 in FIG. 2B represents an example in which the CPU111 enlarges the preview image 202 and expands the preview display area201, by receiving the pinch-out operation performed by the user. In thepresent exemplary embodiment, FIG. 2A is referred to as “normal displaymode”, and FIG. 2B is referred to as “enlargement display mode”. Inother words, the normal display mode indicates a state where the previewdisplay area 201, the navigation area 217, and the page control area 218are displayed on the preview screen 200. The enlargement display modeindicates a state where the navigation area 217 and the page controlarea 218 are not displayed, the preview display area 201 is expanded,and a preview image enlargement button 213 through a close button 216are displayed, on the preview screen 200.

The preview image enlargement button 213 is provided to enlarge thepreview image 202 displayed in the preview display area 201, and todisplay the enlarged preview image 202. The preview image enlargementbutton 213 has a role similar to the role of the preview imageenlargement button 206, in terms of enlargement display of the previewimage 202. The preview image enlargement button 206 and the previewimage enlargement button 213 may have different enlargement ratios.Thus, the preview image 202 enlarged at an optimum enlargement ratio foreach display mode can be displayed. In the present exemplary embodiment,the enlargement ratio is determined in three levels. The preview image202 is displayed in the preview display area 201, while having thedisplay size corresponding to the enlargement ratio increased by onelevel each time a touch on the preview image enlargement button 213 isdetected.

A preview image reduction button 214 is provided to reduce the previewimage 202 displayed in the preview display area 201, and to display thereduced preview image 202. When the user touches the preview imagereduction button 214, the CPU 111 reduces the preview image 202 to apredetermined display size and displays the reduced preview image 202 inthe preview display area 201.

A preview image movement button 215 is provided to move the displayposition of the preview image 202 displayed in the preview display area201. When the user touches the preview image movement button 215, theCPU 111 moves the display position of the image for a predeterminedmovement amount, and displays the moved image in the preview displayarea 201. The display area of the preview image 202 moves in a directionindicated by each pressed button.

The close button 216 is provided to end the enlargement display mode, tocause a change to a screen layout of the normal display mode. When theuser touches the close button 216, the CPU 111 changes the displaycontent from the enlargement display mode to the normal display mode.

Here, control for performing reduction display of the preview image 202by the pinch-in operation of the user will be described. In the presentexemplary embodiment, the user can reduce and display the preview image202, by performing the pinch-in operation while touching the previewdisplay area 201 with fingers, or pens.

Assume that the pinch-in operation for the preview display area 201 isperformed, and the amount of a change in the distance between touchpositions at two points becomes equal to or less than a predeterminedvalue. The CPU 111 then performs processing of reducing the display sizeof the preview image 202 according to the amount of the change. Further,the CPU 111 identifies touch center coordinates of touch positions attwo or more points, and places the preview image 202 at a positionreduced with reference to the identified touch center coordinates,relative to the preview display area 201.

Further, when detecting the touch-end and determining that the pinch-inoperation has ended, the CPU 111 changes the display content from theenlargement display mode to the normal display mode, if the display sizeof the preview screen 200 is equal to or less than a predeterminedthreshold. The CPU 111 then hides the preview image enlargement button213 thorough the close button 216, and displays the navigation area 217and the page control area 218.

The user can continually switch between the pinch-out operation and thepinch-in operation, while touching the touch panel 118 with the fingers,or the pens. For example, if the user increases and decreases thedistance between two fingers continually, while touching the surface ofthe touch panel 118 with the two fingers, the display size of thepreview image 202 increases and decreases alternately. Here, assume thatthe display size of the preview image 202 in the normal display mode isa reference size (100%), and whether the display size of the previewimage 202 exceeds 100% is the only condition for switching between theenlargement display mode and the normal display mode. In this case,switching between the two display modes is frequently performed. As aresult, the screen viewed by the user flickers, due to enlargement andreduction of the preview display area 201, as well as display andnon-display of the navigation area 217 and the page control area 218.Therefore, in the present exemplary embodiment, a condition forswitching from the normal display mode to the enlargement display modeby the pinch operation is different from a condition for switching fromthe enlargement display mode to the normal display mode by the pinchoperation. More specifically, the condition for switching from thenormal display mode to the enlargement display mode is a state where thedisplay size of the preview image 202 exceeds 100%. In other words, thecondition in this case is a state where the distance between the twopoints is increased by the pinch-out operation, and the amount of achange in this increase exceeds a predetermined value. On the otherhand, the condition for switching from the enlargement display mode tothe normal display mode is a state where the display size of the previewimage 202 is decreased to or below 100% by the pinch-in operation, andthe touch-end operation is performed. For example, when the user startsthe pinch-out operation in the normal display mode, and then if thedisplay size of the preview image 202 exceeds 100%, switching to theenlargement display mode occurs even if there is a finger or pentouching the surface of the touch panel 118. On the other hand, when theuser starts the pinch-in operation in the enlargement display mode,switching to the normal display mode does not occur as long as there isa finger or pen touching the surface of the touch panel 118, even if thedisplay size of the preview image 202 becomes equal to or less than100%. The switching to the normal display mode occurs, when the fingeror pen leaves. Next, a specific example of a method of changing thedisplay position of the preview image 202 displayed in the previewdisplay area 201 will be described. When detecting a drag operation forthe preview display area 201, the CPU 111 of the MFP 101 identifies adirection and a movement amount of the drag operation. According to thedirection and the movement amount of the drag operation, the displayposition of the preview image 202 in the preview display area 201 ischanged. For example, for a drag operation to move a touch position fora specific distance in a rightward direction, the display position ofthe preview image 202 relative to the preview display area 201 is movedin the rightward direction for the specific distance. When the previewimage 202 is reduced and displayed by performing the pinch-in operationin the enlargement display mode in FIG. 2B, and then the drag operationin the rightward direction is performed, a preview screen in FIG. 2Cappears. Here, if the pinch-in operation is further performed, andthereby the enlargement display mode is switched to the normal displaymode, the navigation area 217 and the page control area 218 may belocated at a position overlapping the preview image 202. Therefore, whenthe pinch-in operation is determined to have ended, and the layout isswitched from the enlargement display mode to the normal display mode,the preview image 202 is moved to and displayed at a portion notoverlapping the navigation area 217 and the page control area 218. Forexample, the preview image 202 is placed so that the center of thepreview image 202 coincides with the center of the preview display area201 of the normal display mode.

This prevents such an inconvenience that the user cannot press a buttonor cannot confirm information due to the preview image 202 overlappingthe navigation area 217 and the page control area 21. Therefore, theuser can be provided with high operability.

Further, as a method of switching from the normal display mode to theenlargement display mode, switching by an operation other than thepinch-out operation may be adopted. For example, the CPU 111 may switchthe display content from the normal display mode to the enlargementdisplay mode, when the user touches the preview image enlargement button206. In another method, the CPU 111 may switch the display content fromthe normal display mode to the enlargement display mode, when the userclicks the preview image 202 or the preview display area 201 in thenormal display mode.

Furthermore, as a method of switching the display content from theenlargement display mode to the normal display mode, switching by anoperation other than the pinch-out operation and the touch on the closebutton 216 may be adopted. For example, the CPU 111 may switch thelayout from the enlargement display mode to the normal display mode, ifthe CPU 111 determines that the display size of the preview image 202 issmaller than a predetermined display size, when the user touches thepreview image reduction button 214. Such switching between the modes byone or more methods has an effect of improving usability of the user.

Next, a series of processes for changing the display content of thepreview screen 200 displayed in the display 119 by the user operationwill be described in detail, with reference to a flowchart in FIG. 3(consisting of FIGS. 3A and 3B). The CPU 111 of the MFP 101 performs theprocess in each step in FIG. 3, by executing a program. The program tobe executed is stored in a memory such as the ROM 113 and the externalmemory 120, and is executed by being loaded in the RAM 112.

In step S301, the CPU 111 receives a user operation performed on thetouch panel 118. Next, in step S302, the CPU 111 determines whether theoperation detected in step S301 is a click operation. When the detectedoperation is determined to be a click operation (YES in step S302), theprocessing proceeds to step S303. When the detected operation isdetermined not to be a click operation (NO in step S302), the processingproceeds to step S309.

In step S303, the CPU 111 determines whether the click operation is anoperation performed on the preview image enlargement button 206. Whenthe click operation is determined to be an operation performed on thepreview image enlargement button 206 (YES in step S303), the processingproceeds to step S306. When the click operation is determined not to bean operation performed on the preview image enlargement button 206 (NOin step S303), the processing proceeds to step S304. In step S304, theCPU 111 determines whether the click operation is an operation for thepreview image 202. When the click operation is determined to be anoperation performed on the preview image 202 (YES in step S304), theprocessing proceeds to step S305. When the click operation is determinednot to be an operation performed on the preview image 202 (NO in stepS304), no display change is performed for the preview display area 201.Processing to be performed in this case is different from the processingfor a display change for the preview image 202 and the preview displayarea 201. However, such processing is not directly related to thepresent disclosure, and therefore will not be described.

In step S305, the CPU 111 determines whether the display content of thecurrent preview screen 200 corresponds to the normal display mode. Onlyin the normal display mode, display switching to the enlargement displaymode including processing of expanding the preview display area 201 isperformed by receiving the click operation for the preview image 202.When it is determined to correspond to the normal display mode (YES instep S305), the processing proceeds to step S306. When it is determinednot to correspond to the normal display mode (NO in step S305), the CPU111 performs no display change for the preview image 202 and the previewdisplay area 201.

In step S306, the CPU 111 increases the display size of the previewimage 202. Further, in step S307, the CPU 111 expands the previewdisplay area 201, by hiding the navigation area 217 and the page controlarea 218. Furthermore, in step S308, the CPU 111 changes the displayposition of the preview image 202, so that the center of the previewimage 202 increased in the display size and the center of the previewdisplay area 201 are at the same position.

In step S309, the CPU 111 determines whether the event detected in stepS301 is a touch-move event. When the detected event is determined to bea touch-move event (YES in step S309), the processing proceeds to stepS310. When the detected event is determined not to be a touch-move event(NO in step S309), the processing proceeds to step S321.

In step S310, based on the detected touch-move event, the CPU 111determines whether the operation of the user is a drag operation. Whenthe detected touch-move event includes only one point, and a change inposition coordinates of this point becomes equal to or longer than apredetermined distance, the operation is determined to be a dragoperation. The operation is determined not to be a drag operation, whenthe detected touch-move event includes two or more points. When theoperation is determined to be a drag operation (YES in step S310), theprocessing proceeds to step S311. When the operation is determined notto be a drag operation (NO in step S310), the processing proceeds tostep S313. In step S311, the CPU 111 determines whether the display ofthe current preview screen 200 corresponds to the enlargement displaymode. Only in the enlargement display mode, processing of changing thedisplay position of the preview image 202 is performed by receiving thedrag operation for the preview image 202. When the display is determinedto correspond to the enlargement display mode (YES in step S311), theprocessing proceeds to step S312. When the display is determined not tocorrespond to the enlargement display mode (NO in step S311), the CPU111 performs no display change for the preview image 202 and the previewdisplay area 201. In step S312, the CPU 111 changes the display positionof the preview image 202 relative to the preview display area 201,according to a direction and a movement amount of this drag.

In step S313, the CPU 111 determines whether the touch-move operation isa pinch-out operation. More specifically, based on a change in theposition coordinates of the detected touch-move event including the twopoints, the CPU 111 determines whether there is a movement in adirection of increasing the distance between the touch positions at thetwo points. The CPU 111 also determines whether a difference between thedistance of the touch positions at the two points when initiallydetected, and the distance after the movement of at least either one ofthe two points, exceeds the above-described predetermined value. Whenthe touch-move operation is determined to be a pinch-out operation (YESin step S313), the processing proceeds to step S314. When the touch-moveoperation is determined not to be a pinch-out operation (NO in stepS313), the processing proceeds to step S318.

In step S314, the CPU 111 increases the display size of the previewimage 202. Further, in step S315, the CPU 111 places the preview image202 at a position enlarged with reference to the touch centercoordinates.

In step S316, the CPU 111 determines whether the display of the currentpreview screen 200 corresponds to the normal display mode. When thedisplay is determined to correspond to the normal display mode (YES instep S316), the processing proceeds to step S317. When the display isdetermined not to correspond to the normal display mode (NO in stepS316), no display change is performed for the preview image 202 and thepreview display area 201. In step S317, the CPU 111 expands the previewdisplay area 201, by hiding the navigation area 217 and the page controlarea 218. In other words, when the pinch-out operation begins in thenormal display mode, display switching from the normal display mode tothe enlargement display mode is performed.

In step S318, the CPU 111 determines whether the touch-move operation isa pinch-in operation. More specifically, based on a change in theposition coordinates of the detected touch-move event including the twopoints, the CPU 111 determines whether there is a movement in adirection of decreasing the distance between the touch positions at thetwo points. The CPU 111 also determines whether a difference between thedistance of the touch positions at the two points when initiallydetected, and the distance after the movement of at least either one ofthe two points, exceeds the above-described predetermined value. Whenthe touch-move operation is determined to be a pinch-in operation (YESin step S318), the processing proceeds to step S319. When the touch-moveoperation is determined not to be a pinch-in operation (NO in stepS318), no display change is performed for the preview image 202 and thepreview display area 201. In step S319, the CPU 111 reduces the displaysize of the preview image 202. Further, in step S320, the CPU 111 placesthe preview image 202 at a position reduced with reference to the touchcenter coordinates.

In step S321, the CPU 111 determines whether the operation detected instep S301 is a touch-end operation. When the operation is determined tobe a touch-end operation (YES in step S321), the processing proceeds tostep S322. When the operation is determined not to be a touch-endoperation (NO in step S321), no display change is performed, and theprocessing ends.

In step S322, the CPU 111 determines whether the display size of thepreview image 202 is equal to or less than a predetermined threshold.When the received event is a touch-end operation due to a release of thefinger or pen from the pinch-in operation, and the display size of thepreview image 202 becomes equal to or less than the threshold, thedisplay content is switched from the enlargement display mode to thenormal display mode. Here, assume that, the display size of the previewimage 202 displayed in the normal display mode is a reference value (adisplay scaling factor of 100%), and reduction of the display scalingfactor to 100% by the pinch-in is a condition for switching to thenormal display mode. In the present exemplary embodiment, the samedisplay size as the preview image 202 displayed in the normal displaymode is assumed to be the threshold. When the CPU 111 determines thatthe display size of the preview image 202 is equal to or less than thepredetermined threshold (YES in step S322), the processing proceeds tostep S323. When the display size of the preview image 202 is not equalto or less than the predetermined threshold (NO in step S322), noprocessing is performed.

In step S323, the CPU 111 hides some or all of the preview imageenlargement button 213 through the close button 216, while displayingthe navigation area 217 and the page control area 218, and reduces thepreview display area 201. In other words, the CPU 111 switches thedisplay content from the enlargement display mode to the normal displaymode.

In step S324, the CPU 111 changes the display position of the previewimage 202, so that the center of the preview image 202 and the center ofthe reduced preview display area 201 are at the same position.

As described above, according to the present exemplary embodiment, thecondition for switching the display content of the preview screen 200from the normal display mode to the enlargement display mode isdifferent from the condition for switching the display content of thepreview screen 200 from the enlargement display mode to the normaldisplay mode by the pinch operation.

More specifically, the condition for switching from the normal displaymode to the enlargement display mode is the timing at which the start ofthe pinch-out operation (start of a movement of a finger) is detected.On the other hand, the condition for switching from the enlargementdisplay mode to the normal display mode is the timing at which the endof the pinch-in operation (a release of a finger) is detected. Inperforming two-way switching between two different display contents,i.e., between the normal display mode and the enlargement display mode,the start of the pinch-out operation and the end of the pinch-inoperation having no continuity therebetween are provided as theconditions. Therefore, no flickering phenomenon occurs, so thatcomfortable operability can be provided.

Further, the switching conditions of the enlargement display mode andthe normal display mode may be reversed. More specifically, thecondition for switching from the normal display mode to the enlargementdisplay mode may be the timing at which the end of the pinch-outoperation (a release of a finger) is detected. Further, as for theswitching from the enlargement display mode to the normal display mode,a state where the display size of the preview image 202 reaches apredetermined threshold may be provided as the only condition, withoutsetting the end of the pinch-in operation as the condition.

In addition, according to the present exemplary embodiment, other thanthe buttons for operating the preview image 202 and the button forending the enlargement display mode, the buttons are not displayed inthe enlargement display mode. Therefore, unnecessary buttons are notdisplayed, which produces an effect of enhancing convenience.

Moreover, in the present exemplary embodiment, the navigation area 217and the page control area 218 are described to be hidden in theenlargement display mode, but only either one may be hidden.Alternatively, the display area may be reduced and displayed in theenlargement display mode, without hiding the navigation area 217 and thepage control area 218.

According to the present exemplary embodiment, the preview imageenlargement button 213 and the preview image reduction button 214 aredisplayed in the enlargement display mode, but another configuration maybe employed. For example, when the display content is switched from thenormal display mode to the enlargement display mode by the pinch-outoperation, the preview image enlargement button 213 and the previewimage reduction button 214 may be hidden. In this case, the number ofdisplayed buttons is smaller, which reduces confusion for the user,thereby producing an effect of enhancing convenience.

In the above-described exemplary embodiment, the MFP is taken as anexample of the device implementing the present disclosure. However, thedevice implementing the present disclosure is not limited to the MFP. Inother words, the present disclosure is applicable to image processingapparatuses that are at least capable of processing image data,including image formation apparatuses such as a print apparatus, ascanner, a facsimile, and a digital camera, as well as image processingapparatuses such as a PC and a mobile information terminal, withoutbeing limited to the MFP.

The present disclosure is also implemented by executing the followingprocessing. First, software (a computer program) that implements thefunctions of the above-described exemplary embodiment is supplied to asystem or apparatus via a network or storage medium. Next, a computer(or a CPU or MPU) of the system or apparatus reads the program and thenexecutes the read program. In this case, the program and the storagemedium storing the program form an exemplary embodiment of the presentdisclosure.

According to an exemplary embodiment of the present disclosure, a usercan be provided with comfortable operability, in switching between twodisplay modes having different screen layouts, based on a multi-touchoperation.

Other Embodiments

Embodiment(s) of the present disclosure can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment(s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment(s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment(s) and/or controlling the one or more circuits to perform thefunctions of one or more of the above-described embodiment(s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

While the present disclosure has been described with reference toexemplary embodiments, it is to be understood that the disclosure is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of priority from Japanese PatentApplication No. 2015-001677, filed Jan. 7, 2015, which is herebyincorporated by reference herein in its entirety.

What is claimed is:
 1. An image processing apparatus with a touch panelcomprising at least one processor that executes a program to functionas: a detection unit configured to be capable of detecting a touch of aninput instruction member on the touch panel, and a position of the touchof the input instruction member, and a release of the input instructionmember touching the touch panel from the touch panel; a display controlunit configured to be capable of switching between a first display modefor displaying a screen including a first display area for displaying apreview image and a second display area in which the preview image isnot displayed, the second display area being for displaying at least onebutton for operating the preview image being displayed on the firstdisplay area, and a second display mode for expanding the first displayarea to be larger than the first display area in the first display mode,and hiding the second display area, or reducing the second display areaand displaying the reduced second display area; and a calculation unitconfigured to calculate a distance between or among at least two inputinstruction members touching the first display area, based on thedetecting result of the detection unit, wherein, based on the distancebetween or among at least two input instruction members touching thefirst display area, the display control unit enlarges or reduces thepreview image being displayed in the first display area, and switchesbetween the first display mode and the second display mode based onenlargement or reduction in size of the preview image.
 2. The imageprocessing apparatus according to claim 1, wherein, in the first displaymode, in a case where the distance between or among the at least twoinput instruction members touching the first display area is apredetermined value or more, the display control unit enlarges thepreview image being displayed in the first display area and switchesfrom the first display mode to the second display mode, and wherein, inthe second display mode, in a case where the distance between or amongthe at east two input instruction members touching the first displayarea is a predetermined value or less, the display control unit reducesthe preview image being displayed in the first display area, and, in acase where it is detected that the number of input instruction memberstouching the first display area, among the at least two inputinstruction members, becomes equal to or less than one, the displaycontrol unit switches from the second display mode to the first displaymode.
 3. The image processing apparatus according to claim 2, wherein,in the second display mode, in a case where it is detected that thenumber of input instruction members touching the first display area,among the at least two input instruction members, becomes equal to orless than one, and a display size of the preview image becomes equal toor less than a predetermined threshold, the display control unitswitches from the second display mode to the first display mode.
 4. Theimage processing apparatus according to claim 3, wherein, in the seconddisplay mode, in a case where it is detected that the number of inputinstruction members touching the first display area, among the at leasttwo input instruction members, becomes equal to or less than one, andthe display size of the preview image is greater than a predeterminedsize, the display control unit omits to switch from the second displaymode to the first display mode.
 5. The image processing apparatusaccording to claim 2, wherein, when the second display mode is switchedto the first display mode, the display control unit places the previewimage, so as to match centers of the first display area and the previewimage.
 6. The image processing apparatus according to claim 1, furthercomprising a storage unit configured to store image data, wherein, inthe first display area, a preview image of the image data stored in thestorage unit is displayed.
 7. The image processing apparatus accordingto claim 1, wherein, in the first display area, one or a plurality ofpreview images is displayed.
 8. The image processing apparatus accordingto claim 1, wherein, in the second display area, at least one of atransmission instruction button used to provide an instruction fortransmitting the preview image displayed in the first display area, anda print instruction button used to provide an instruction for printingthe preview image displayed in the first display area, is displayed. 9.The image processing apparatus according to claim 1, wherein, in thesecond display area, at least one of a change button used to change apage of the preview image displayed in the first display area, and adeletion button used to delete a page corresponding to the preview imagedisplayed in the first display area is displayed.
 10. The imageprocessing apparatus according to claim 1, further comprising a readingunit configured to generate an image by reading an image on an originaldocument.
 11. The image processing apparatus according to claim 1,further comprising a printing unit configured to print an image.
 12. Theimage processing apparatus according to claim 1, wherein, in the firstdisplay mode, in a case where the distance between or among the at leasttwo input instruction members touching the first display area is apredetermined value or more, the display control unit enlarges thepreview image being displayed in the first display area and, in a casewhere it is detected that the number of input instruction memberstouching the first display area, among the at least two inputinstruction members, becomes equal to or less than one, the displaycontrol unit switches from the first display mode to the second displaymode, and wherein, in the second display mode, in a case where thedistance between or among the at least two input instruction memberstouching the first display area is a predetermined value or less, thedisplay control unit reduces the preview image being displayed in thefirst display area, and in a case where a display size of the previewimage becomes equal to or less than a predetermined threshold, thedisplay control unit switches from the second display mode to the firstdisplay mode.
 13. A control method for an image processing apparatushaving a touch panel and capable of detecting a touch of an inputinstruction member on the touch panel, and a position of the touch ofthe input instruction member, and a release of the input instructionmember touching the touch panel from the touch panel, the control methodcomprising: controlling display to switch between a first display modefor displaying a screen including a first display area for displaying apreview image and a second display area in which the preview image isnot displayed, the second display area being for displaying at east onebutton for operating the preview image being displayed on the firstdisplay area, and a second display mode for expanding the first displayarea to be larger than the first display area in the first display mode,and hiding the second display area, or reducing the second display areaand displaying the reduced second display area; and calculating adistance between or among at least two input instructions memberstouching the first display area, cased on the detecting result, wherein,based the distance between or among at least two input instructionmembers touching the first display area, enlarging or reducing thepreview image being displayed in the first display area, and switchingbetween the first display mode and the second display mode based onenlargement reduction in size of the preview image.
 14. A non-transitorystorage medium storing a program for causing a computer to execute acontrol method for an image processing apparatus having a touch paneland capable of detecting a touch of an input instruction member on thetouch panel, and a position of the touch of the input instructionmember, and a release of the input instruction member touching the touchpanel from the touch panel, the control method comprising; controllingdisplay to switch between a first display mode for displaying a screenincluding a first display area for displaying a preview image and asecond display area in which the preview image is not displayed, thesecond display area being for displaying at least one button foroperating the preview image being displayed on the first display area,and a second display mode for expanding the first display area to belarger than the first display area in the first display mode; and hidingthe second display area, or reducing the second display area anddisplaying the reduced second display area; and calculating a distancebetween or among at least two input instructions members touching thefirst display area, based on the detecting result, wherein; based thedistance between or among at least two input instruction memberstouching the first display area, enlarging or reducing the preview imagebeing displayed in the first display area, and switching between thefirst display mode and the second display mode based on enlargementreduction in size of the preview image.